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Abstract 

Objective To estimate the relative risks of death, myocardial infarction, 
stroke, and renal failure or dysfunction between antifibrinolytics and no 
treatment following the suspension of aprotinin from the market in 2008 
for safety reasons and its recent reintroduction in Europe and Canada. 

Design Systematic review and network meta-analysis. 

Data sources A Cochrane review of antifibrinolytic treatments was 
chosen as the starting point for this systematic review. Medline, Embase, 
and the Cochrane register of trials were searched with no date restrictions 
for observational evidence. 

Study selection Propensity matched or adjusted observational studies 
with two or more of the interventions of interest (aprotinin, tranexamic 
acid, epsilon-aminocaproic acid, and no treatment) that were carried out 
in patients undergoing cardiac surgery. 

Data analysis Network meta-analysis was used to compare treatments, 
and odds ratios with 95% credible intervals were estimated. 
Meta-analyses were carried out for randomised controlled trials alone 
and for randomised controlled trials with observational studies. 

Results 1 06 randomised controlled trials and 1 1 observational studies 
(43 270 patients) were included. Based on the results from analysis of 
randomised controlled trials, tranexamic acid was associated on average 
with a reduced risk of death compared with aprotinin (odds ratio 0.64, 
95% credible interval 0.41 to 0.99). When observational data were 
incorporated, comparisons showed an increased risk of mortality with 
aprotinin on average relative to tranexamic acid (odds ratio 0.71 , 95% 
credible interval 0.50 to 0.98) and epsilon-aminocaproic acid (0.60, 0.43 
to 0.87), and an increased risk of renal failure or dysfunction on average 
relative to all comparators: odds ratio 0.66 (95% credible interval 0.45 



to 0.88) compared with no treatment, 0.66 (0.48 to 0.91) versus 
tranexamic acid, and 0.65 (0.45 to 0.88) versus epsilon-aminocaproic 
acid. 

Conclusion Although meta-analyses of randomised controlled trials 
were largely inconclusive, inclusion of observational data suggest 
concerns remain about the safety of aprotinin. Tranexamic and 
epsilon-aminocaproic acid are effective alternatives that may be safer 
for patients. 

Introduction 

In 2008, aprotinin (Trasylol; Bayer, Germany), an 
antifibrinolytic drug used to reduce blood loss and exposure to 
transfusion in patients undergoing cardiac surgery, was 
voluntarily withdrawn by the manufacturer. This decision 
occurred after the early stopping of the Blood conservation using 
Antifibrinolytics in a Randomized Trial (BART) study, a trial 
comparing aprotinin with a pair of lysine analog drugs 
(tranexamic acid and epsilon-aminocaproic acid) owing to 
concerns of an increased risk of deaths related to aprotinin.' 
Since then, tranexamic acid and epsilon-aminocaproic acid have 
been used to manage patients at risk of bleeding from cardiac 
surgery. Some have suggested that the withdrawal of aprotinin 
has been detrimental to patient care because of increased adverse 
outcomes from surgery and increased use of blood products, 2 " 4 
whereas others have suggested a relatively minimal change in 
clinical practice. 5 

Most recently the European Medicines Agency has 
recommended the lifting of the suspension of aprotinin for use 
in cardiac surgery. 6 In September of 201 1, following 
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deliberations by an expert committee convened by Health 
Canada, aprotinin was made available again to clinicians. Health 
Canada has requested additional warnings, taking note of studies 
that have found an increased risk of kidney problems and death 
associated with use of non-indicated aprotinin. Given the history 
of aprotinin, the extent to which it may be used by clinicians is 
unclear, with recent surveys of cardiac anaesthesiologists 
illustrating divided opinions. 2 

To explore further the relative safety of aprotinin compared 
with alternative treatments, we carried out network 
meta-analyses for the outcomes of death, myocardial infarction, 
stroke, and renal failure or dysfunction using all available 
evidence. We used data from both randomised controlled trials 
and observational studies, and to permit simultaneous 
comparisons between all treatments we made use of network 
meta-analysis. 

Methods 
Inclusion criteria 

We sought studies that enrolled patients undergoing cardiac 
surgery using cardiopulmonary bypass. No restrictions were set 
for surgical history (primary or repeat), urgency (elective or 
emergent), or type (coronary artery bypass graft, valve, or other 
cardiac procedures). We considered randomised controlled trials 
to be eligible for inclusion if at least two of the following 
treatments of interest were compared: aprotinin, tranexamic 
acid, epsilon-aminocaproic acid, or no treatment (including 
placebo). No restrictions on drug dose were applied. We only 
chose studies reporting results for death, myocardial infarction, 
stroke, or renal failure or dysfunction. Propensity matched and 
adjusted observational studies were also included. Although 
observational studies cannot be considered to be as free of 
confounding and selection bias as randomised controlled trials, 
including data from them can help to offset limitations of 
analysing rare outcomes such as harms using only randomised 
controlled trials, 7 " 9 and may also help increase generalisability. 

Study identification 

Given its rigorous methods, we chose the most recent update 
of the Cochrane review 10 of antifibrinolytic treatments as the 
starting point for this systematic review; we removed trials 
carried out in patient populations other than those requiring 
cardiac surgery. This review was based on a search of three 
databases using a peer reviewed search strategy, with 
independent screening and data collection by two reviewers. 
We also carried out a literature search of Medline, Embase, and 
the Cochrane register of controlled trials to find trials or 
propensity matched or propensity adjusted observational studies 
not included in the Cochrane review (see supplementary tables 
1 and 2 for the search strategy). Two researchers (BH, DM) 
screened citations independently for further studies and 
classified them as relevant or irrelevant. 

Data collection 

Data on outcome and quality assessment from randomised 
controlled trials in the 201 1 Cochrane review were subjected 
to double data extraction, but for the purposes of this study were 
extracted by one researcher (BH). The same reviewer was also 
responsible for extraction of data from additional studies. Where 
observational studies consisted of analyses based on propensity 
matched samples as well as larger, unmatched samples, we 
collected the information from the propensity matched sample. 
The Cochrane review used as a basis for our work assessed trial 



quality using the Cochrane risk of bias scale, which considers 
sequence generation, allocation concealment, and blinding. The 
Newcastle Ottawa scale" was used to assess the quality of 
observational studies; for cohort studies this scale assigns points 
for representativeness of the exposed and control groups, 
adequate ascertainment of exposure, clarity of the absence of 
outcomes at study start, comparability of groups based on study 
design and analysis, blinded assessment or record linkage to 
confirm study outcomes, sufficiency of follow-up duration to 
observe the outcomes of interest, and reporting of a sufficiently 
low withdrawal rate that would not threaten a great risk of bias 
to the study. A maximum of nine points can be assigned. 

Evidence synthesis 

We used a two stage approach to evidence synthesis: in the first 
stage we used data from randomised controlled trials alone and 
in the second stage we added data from propensity matched or 
adjusted studies, allowing for the assessment of the additional 
contribution from observational studies. Sensitivity analyses 
were carried out wherein we removed randomised controlled 
trials from the network of treatments that were not scored as 
having both adequate allocation concealment and double 
blinding in the Cochrane review 1 ", removed studies that used 
propensity scores in ways other than matching of patients in 
competing intervention groups (such studies may have greater 
residual confounding compared with propensity matched 
studies), and where we considered these two restrictions 
simultaneously. 

For each of the four clinical outcomes of interest (death, 
myocardial infarction, stroke, renal failure or dysfunction) we 
carried out the mixed treatment comparisons approach for 
network meta-analysis. 12 To estimate posterior densities for 
unknown variables we used Markov Chain Monte Carlo methods 
through WinBUGS software (version 1.4.3, MRC Biostatistics 
Unit, Cambridge, UK). Given that the safety of aprotinin was 
of primary interest, we chose aprotinin as the reference group 
for all analyses. We used vague prior distributions throughout, 
allowing the data to drive inferences. 

A hierarchical model was used to examine the four clinical 
outcomes of interest. For each outcome, the total number of 
events in the j" 1 study for intervention k is denoted by r jk , and 
the corresponding number of participants is given by n jk . 
Together, this data gives information on the probability of an 
event (p jk ) for each intervention group in each included study. 
A logistic regression model was used wherein each study is 
assigned a reference intervention arm, b,, and a corresponding 
log-odds for the outcome denoted by u,,. Based on this set-up, 
we assumed a log-odds ratio (denoted by (p ) k ) for intervention 
k relative to intervention b t to follow a normal density with mean 
log-odds ratio (d k -d b] ), and between study standard deviation, x, 
where d k is the mean log-odds ratio of outcome for intervention 
compared with usual care (so that d,=0). The model can be 
expressed as log-odds^ k )=u,j if intervention b j5 and 
log-odds(Pi k )=u,i if intervention k; cp j k ~Normal((d k -d bj ), t 2 ). The 
between study variability of treatment effects was assigned a 
uniform (0, 2) prior density and assumed to be the same for all 
pairwise comparisons. 

As recommended by previous researchers, when carrying out 
meta-analyses we excluded trials involving 0 events in all 
treatment arms. 13 All results are reported with point estimates 
and 95% credible intervals for the average treatment effects of 
interest; we also estimated 95% predictive intervals for all 
comparisons to assess the intervention effects in a single study 
setting, as described elsewhere (see supplementary table 4 for 
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this information). 14 13 We estimated the average ranking of each 
treatment, the probability of each odds ratio being larger than 
1, and the probability of a treatment being associated with the 
lowest risk of harm. To present the respective probabilities for 
each combination of outcome and intervention we used bar plots 
and cumulative probability plots (see supplementary figures 1 
and 2). 16 To assess model convergence we used trace plots and 
the Brooks-Gelman-Rubin statistic. 17 For each analysis we fit 
two chains, each employing 50 000 or more iterations, with a 
burn-in of 50 000 iterations. We assessed model fit by 
comparing the residual deviance from each model with the total 
number of unconstrained data points (that is, the number of 
treatment arms across all studies) to ensure these quantities were 
about equal. 13 When carrying out network meta-analysis, 
checking consistency of direct and indirect data is of interest, 
as large differences related to the type of evidence may suggest 
the presence of important differences between data sources. We 
assessed consistency between direct and indirect evidence as 
described previously, which involved comparison of deviance 
information criteria between our primary mixed treatment 
comparison models and alternative node splitting models. 18 In 
the supplementary material we also report estimates from 
meta-analyses of head to head data only for comparison purposes 
to further enable consideration of inconsistencies between direct 
and indirect evidence. 

Results 

Overall, 106 eligible randomised controlled trials were identified 
from the Cochrane review (see supplementary list). The 
remaining 67 trials in patients undergoing cardiac surgery were 
excluded because they did not report data on relevant harms. 
The electronic literature search identified 96 citations for review 
(155 before removal of duplicates); 15 of these were chosen for 
full text screening and 1 1 were retained for final inclusion. 19 " 29 
All were observational studies and no additional randomised 
controlled trials were included. Two studies were of interest, 
but could not be acquired: one of aprotinin compared with 
tranexamic acid and with epsilon-aminocaproic acid (90 
patients) and one of aprotinin compared with tranexamic acid 
(243 patients). 30 31 Figure 1 |J presents a summary of the study 
identification process. Sample sizes from individual trials were 
generally small (median 80, range 18-2329; 63.2% enrolled 
fewer than 100 patients). 

Nine observational studies used propensity matching 
algorithms 2 " 21 23 29 and two were propensity adjusted. 19 22 In our 
analyses, using propensity matched samples where available, 
these studies contributed data from an additional 26 577 
participants (median 1544, range 438-9598). 

Figure 2JJ presents a diagram of studies and treatments for this 
systematic review, and table 1 (J presents the evidence available 
for each clinical outcome (see supplementary table 3 for 
characteristics of the newly included studies). Overall, the 
quality of the randomised studies included in the Cochrane 
review 10 was judged partially limited by a lack of transparency 
in the reporting of the generation of allocation sequences (78 
were judged adequate, 2 inadequate, and 172 unclear), although 
double blinding was considered adequate in 170/252 of trials. 
Among the randomised controlled trials in patients undergoing 
cardiac surgery included in this review, 35 had adequate 
allocation concealment and were double blinded. Based on the 
Newcastle Ottawa scale, the included observational studies were 
judged to be of high quality for measures to protect against 
selection bias and detection bias (see supplementary table 3 for 



a summary of the quality assessment findings of observational 
studies). 

Outcomes 

Mortality 

In total, 82 randomised studies (14 773 patients) were included 
in the analysis. Compared with aprotinin, on average tranexamic 
acid was associated with a reduced risk of mortality (odds ratio 
0.64, 95% credible interval 0.41 to 0.99), whereas 
epsilon-aminocaproic acid and no treatment were associated 
with wide and inconclusive 95% credible intervals (table 2[[). 
The corresponding credible intervals for all other pairwise 
treatment comparisons were wide and inconclusive (see 
supplementary table 5 for analyses restricted to randomised 
controlled trials), although on average tranexamic acid was 
associated with a potentially important reduced risk of death 
relative to no treatment (odds ratio 0.64, 95% credible interval 
0.41 to 1.02). Tranexamic acid was estimated to have a 73.4% 
probability of being the lowest risk of treatment, followed by 
epsilon-aminocaproic acid (24.0%), aprotinin (0.9%), and no 
treatment ( 1 .7%). The between study standard deviation for this 
analysis was estimated to be 0.23. 

When eligible cohort studies were incorporated into the analysis 
(11 studies and 26 577 patients), credible intervals narrowed. 
Relative to aprotinin, tranexamic acid (odds ratio 0.71, 95% 
credible interval 0.50 to 0.98) and epsilon-aminocaproic acid 
(0.60, 0.43 to 0.87) were both on average associated with a 
reduction in risk of mortality compared with aprotinin; the 
comparison with no treatment remained inconclusive (table 2, 
fig 30). Epsilon-aminocaproic acid was associated on average 
with a reduced risk of death relative to no treatment (odds ratio 
0.66, 95% credible interval 0.45 to 1.00), whereas the 
comparisons between tranexamic acid and no treatment as well 
as tranexamic acid and epsilon-aminocaproic acid were 
inconclusive (fig 3). Ranking probabilities were most favourable 
for epsilon-aminocaproic acid and tranexamic acid (table 2 and 
supplementary figure la), and the odds ratios comparing each 
of these treatments with aprotinin were associated with 
probabilities of 99.0% and 98.2% of lower mortality. Prediction 
intervals from all pairwise comparisons based on the available 
data were wide and included 1 (see supplementary table 4), 
suggesting that observed increases in risk may not be present 
in all settings or patients. The between study standard deviation 
for this analysis was estimated to be 0.32. 

Myocardial infarction 

Overall, 67 randomised controlled trials (12 390 patients) were 
included for analysis. Compared with aprotinin, all other 
treatments were associated with wide and inconclusive 95% 
credible intervals (table 2). When all pairwise comparisons 
among the three alternative interventions were reviewed, none 
fully excluded a possible null difference (see supplementary 
table 5). Epsilon-aminocaproic acid was associated with a 69.2% 
probability of being associated with the lowest risk of 
myocardial infarction, followed by tranexamic acid (20.1%), 
aprotinin (8.9%), and no treatment (1.9%). The between study 
standard deviation for this analysis was estimated to be 0.18. 

Addition of data from eligible cohort studies (eight studies, 14 
304 patients) resulted in narrowed 95% credible intervals. 
Comparisons of the three alternatives with aprotinin were 
inconclusive (table 2 and fig 4I|); epsilon-aminocaproic acid 
approached a conclusive benefit (odds ratio 0.78, 95% credible 
interval 0.60 to 1.03), whereas the probabilities in favour of 
epsilon-aminocaproic acid and tranexamic acid were estimated 
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to be 96.6% and 86.2% (table 2). Comparisons among the three 
remaining alternatives were also inconclusive, although 
epsilon-aminocaproic acid approached an average benefit 
compared with no treatment (odds ratio 0.80, 95% credible 
interval 0.60 to 1.04; table 2 and fig 4). Ranking probabilities 
were most favourable for epsilon-aminocaproic acid (table 2 
and supplementary figure lb). Prediction intervals from all 
pairwise comparisons based on the available data were also 
wide and included 1 (see supplementary table 4). The between 
study standard deviation for this analysis was estimated to be 
0.17. 

Stroke 

Overall, 40 randomised controlled trials (7421 patients) were 
included for analysis. Compared with aprotinin, all of the 
alternative treatments were associated with wide and 
inconclusive 95% credible intervals (table 2), and this remained 
true for all possible comparisons among the three remaining 
alternatives (see supplementary table 5). Epsilon-aminocaproic 
acid was associated with the largest probability of being the 
safest treatment (59.6%), followed by aprotinin (15.7%), 
tranexamic acid (13.2%), and no treatment (11.5%) (table 2). 
The between study standard deviation for this analysis was 
estimated to be 0.67. 

Changes occurred in summary estimates when observational 
data were added (10 studies and 24 585 patients), but clinical 
interpretations were relatively unchanged (table 2 and fig 5Jj). 
Compared with aprotinin, all three alternatives were associated 
with estimates that failed to rule out a null difference, and this 
was also true for all possible pairwise comparisons among them. 
Ranking probabilities (table 2 and supplementary figure lc) 
suggested tranexamic acid and epsilon-aminocaproic acid to be 
the two safest treatments (probabilities to be safest were 52.7% 
and 33.6%, whereas probabilities to be the second safest were 
28% and 31%, respectively). Prediction intervals from all 
pairwise comparisons based on the available data were wide 
and included 1 (see supplementary table 4). The between study 
standard deviation for this analysis was estimated to be 0.54. 

Renal failure or dysfunction 

Overall, 28 randomised controlled trials (7656 patients) were 
included for analysis. Compared with aprotinin, all of the 
alternatives were found to be associated with favourable average 
summary estimates but with wide and inconclusive 95% credible 
intervals (table 2), and the same was true for all possible 
pairwise comparisons between the three alternatives (see 
supplementary table 5). The estimated probabilities that aprotinin 
could be associated with greater renal harms relative to no 
treatment, tranexamic acid, and epsilon aminocaproic acid were 
estimated to be 77.8%, 73.2%, and 82.6%. Epsilon-aminocaproic 
acid was associated with the largest probability of being safest 
(42.9%), followed by tranexamic acid (24.2%) and no treatment 
(24.0%). The between study standard deviation for this analysis 
was estimated to be 0.39. 

When observational data were added (nine studies, 23 903 
patients), the average summary estimates as well as 
corresponding clinical interpretations changed. Compared with 
aprotinin, no treatment (odds ratio 0.66, 95% credible interval 
0.45 to 0.88), tranexamic acid (odds ratio 0.66, 95% credible 
interval 0.48 to 0.91), and epsilon-aminocaproic acid (odds ratio 
0.65, 95% credible interval 0.45 to 0.88) were associated with 
summary average effects that represented reductions in the risk 
of renal failure or dysfunction (table 2 and fig 6 J), whereas all 
possible pairwise comparisons between the three alternatives 



were inconclusive (fig 6). Exploration of ranking probabilities 
showed comparable likelihoods of being the safest therapy for 
epsilon-aminocaproic acid (36.5%), no treatment (33.5%), and 
tranexamic acid (30.3%), and the same was true for 
corresponding probabilities of being second most and third most 
safe (see supplementary figure Id). Prediction intervals from 
all pairwise comparisons based on the available data were wide 
and included the null value of 1 (see supplementary table 4), 
suggesting that observed increases in risk may not be present 
in all settings or patients. The between study standard deviation 
for this analysis was estimated to be 0.30. 

Sensitivity analyses, model fit, and 
assessment of inconsistency 

Restriction of studies to all high quality observational studies 
and randomised trials reduced the number of studies in the 
analyses of mortality to 41 (33 262 patients), myocardial 
infarction to 31 (n=19 407), stroke to 28 (n=28 835), and renal 
failure or dysfunction to 23 (n=29 274). In these analyses, point 
estimates for all outcomes consistently showed equivalent or 
stronger benefits for no treatment, tranexamic acid, and 
epsilon-aminocaproic acid compared with aprotinin, although 
with some increase in uncertainty owing to the reduced number 
of studies (see supplementary table 6). On average, the 
conclusive benefit on mortality in favour of 
epsilon-aminocaproic acid remained present, as did benefits 
regarding renal failure or dysfunction for all three comparators. 

Analyses carried out to explore the effect of excluding the two 
studies" 22 that used propensity scores either as a variable in a 
multivariable model" or for data stratification 22 were generally 
associated with improvement of the risk profile for aprotinin 
(see supplementary table 6). However, a conclusive mortality 
benefit favouring epsilon-aminocaproic acid compared with 
aprotinin remained, and tranexamic acid also maintained its 
conclusive benefit regarding the occurrence of renal failure or 
dysfunction. When both low quality randomised controlled trials 
and propensity adjusted studies were excluded simultaneously, 
findings were largely similar to those observed in this analysis. 

The residual deviances from all analyses in this review were 
comparable to the number of unconstrained data points in all 
cases, suggesting adequate model fit (see supplementary table 
7). When deviance information criteria were assessed from node 
splitting models, which were fit to assess the potential for 
inconsistency between direct and indirect evidence, values were 
comparable to those observed with primary analyses, suggesting 
no improvement in model fit. Estimates from pairwise 
meta-analyses of head to head evidence were comparable to 
those generated from network meta-analysis (see supplementary 
table 8). 

Discussion 

Following withdrawal from the market in 2008 because of 
concerns about safety, aprotinin has been reintroduced in both 
Europe (2012) and Canada (201 1). Given these recent 
developments, we considered a comprehensive synthesis of all 
evidence to be worthwhile. Based on our findings from network 
meta-analyses, synthesis of evidence from randomised trials 
alone generally produced inconclusive estimates of the relative 
risks of death, myocardial infarction, stroke, or renal failure or 
dysfunction associated with using the antifibrinolytic aprotinin 
in cardiac surgery compared with no treatment, tranexamic acid, 
and epsilon-aminocaproic acid (although tranexamic acid was 
associated with a lower risk of mortality). Subsequent to 
inclusion of data from observational studies, our summary 
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estimates suggested aprotinin to be associated on average with 
clinically important increased risks of mortality and renal failure 
or dysfunction in our work, although corresponding prediction 
intervals suggest that variations in patients' comorbidities, 
surgical history, or type of procedure play a part. From a 
decision making perspective, although several of the summary 
estimates from our meta-analyses were associated with 
inconclusive credible intervals, corresponding probabilities 
presented in this work can be used to help inform choices. 16 In 
most cases the active alternatives of tranexamic acid and 
epsilon-aminocaproic acid were associated with increased safety 
on average. To our knowledge, this work represents the first 
application of network meta-analysis to combine data from 
randomised and observational studies to assess drug safety, an 
approach that may be particularly helpful for assessment of data 
on harms. Such an approach can be implemented sequentially 
to assess how observational evidence contributes to overall 
findings. 

How the return of aprotinin to the market in Europe and Canada 
will be received by cardiac surgeons and anaesthesiologists is 
unclear. Several authors have addressed whether practice has 
changed since Bayer stopped the marketing of aprotinin, and 
whether those changes have been associated with expected 
changes in clinical outcomes. One review 32 summarised several 
such studies that explored the implications associated with the 
use compared with non-use of aprotinin after its withdrawal. 2 " 4 28 
Based on these studies, the reviewer noted that while recent 
reports have documented increases in lengths of hospital stay, 
extent of bleeding, rates of reoperation, and usage of other costly 
blood products (including fresh frozen plasma and factor VII), 
reports suggesting improvements in patients' clinical outcomes 
and reductions in costs are still lacking. In contrast, researchers 5 
recently suggested that withdrawal of aprotinin had little impact 
on practice or patient outcomes, noting that their research 
showed there had been no important changes in the proportion 
of patients receiving a red blood cell transfusion, and that there 
were no changes in rates of reoperation, readmission to hospital 
within one month, or 30 day mortality. 

Comparisons with other studies 

Meta-analyses of aprotinin in cardiac surgery have clearly shown 
the benefits of this drug compared with placebo for reduction 
of blood loss and exposure to transfusion. 10 33 35 However, our 
data suggest the potential for increased risk of renal dysfunction 
or failure, and thus the risk-benefit ratio of aprotinin is unclear. 
Systematic reviews have shown clinical benefits of the drug 
alternatives tranexamic acid and epsilon-aminocaproic acid 1 " 33 36 ; 
whereas their impacts on blood loss and exposure to transfusion 
may be smaller than those of aprotinin (the effect of 
epsilon-aminocaproic acid perhaps being smallest), they remain 
clinically important, and findings from this systematic review 
suggest more favourable safety profiles for both treatments. 
Given these findings, use of tranexamic acid or 
epsilon-aminocaproic acid in place of aprotinin may prove more 
clinically attractive to physicians given the potential benefits 
for increased patient safety. 

Strengths and limitations of this review 

Our review has limitations. Although observational studies 
increased our sample sizes and in some comparisons led to 
strong results, even propensity adjusted and matched studies 
may have residual confounding. Raw data from two propensity 
adjusted studies were used in place of their adjusted odds ratios. 
We addressed this concern by carrying out a sensitivity analysis 
with these studies omitted, and still observed important 



differences between treatments. Additionally, some of the 
observational research captured varied doses of the treatments 
studied. Data extraction for articles was done by one reviewer; 
however, in the case of most included studies derived from the 
Cochrane review, data had previously been collected in 
duplicate. 

Conclusions 

Results from our network meta-analyses of randomised and 
observational studies suggest that on average concerns about 
the safety of aprotinin use in patients undergoing cardiac surgery 
still remain. Clinicians need to be mindful of the benefits and 
risks surrounding the use of aprotinin in their practice, as 
alternative drugs are available that may offer greater safety to 
their patients. 
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What is already known on this topic 

After suspension from the market in 2008 related to trial findings, aprotinin has been put back on the market in Canada (201 1 ) and 
Europe (2012) 

Important observational evidence about the safety of antifibrinolytics warrants consideration in syntheses of the evidence to study the 
safety of these drugs 

What this study adds 

Although meta-analyses of randomised controlled trials were largely inconclusive, inclusion of observational data suggest concerns 
remain about the safety of aprotinin in cardiac surgery 

Tranexamic and epsilon-aminocaproic acid are effective alternatives that may be safer for patients 
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Tables 



e 1 1 Amount of data available for meta-analyses, by outcome 



Clinical outcome by study design No of studies (No of patients) 


Mortality: 


Randomised controlled trials 


82(14 773) 


Observational studies 


1 1 (26 577) 


Myocardial infarction: 


Randomised controlled trials 


67 (12 390) 


Observational studies 


8 (14 304) 


Stroke: 


Randomised controlled trials 


40 (7 421) 


Observational studies 


10 (24 585) 


Renal failure or dysfunction: 


Randomised controlled trials 


28 (7656) 


Observational studies 


9 (23 903) 
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Table 2| Summary of results from network meta-analysis 

Findings from syntheses of RCTs Findings from syntheses of RCTs and observational studies 

P(safest)* (%), P(safest)* (%), 

average rank of P(odds ratio <1)t average rank of P(odds ratio <1)t 



Treatment 


Odds ratio (95% Crl) 


treatment! 


(%) 


Odds ratio (95% Crl) 


treatment! 


(%) 


Mortality: 


Aprotinin 


Reference group 


0.9; 3.29 


Reference group 


Reference group 


0;3.76 


Reference group 


No treatment 


0.99 (0.72 to 1 .36) 


1.7; 3.23 


51.7 


0.91 (0.71 to 1.16) 


0.7; 3.11 


78.1 


Tranexamic acid 


0.64 (0.41 to 0.99) 


73.4; 1 .30 


97.6 


0.71 (0.50 to 0.98) 


22.7; 1.88 


98.2 


Epsilon-aminocaproic 
acid 


0.79 (0.47 to 1 .55) 


24.0; 2.19 


79.2 


0.60 (0.43 to 0.87) 


76.6; 1.26 


99.0 


Myocardial infarction: 


Aprotinin 


Reference group 


8.9; 2.61 


Reference group 


Reference group 


1.2; 3.42 


Reference group 


No treatment 


1.14 (0.89 to 1.47) 


1.9; 3.55 


17 


0.98 (0.81 to 1.20) 


2.2; 3.13 


59.8 


Tranexamic acid 


0.95 (0.66 to 1 .44) 


20.1; 2.36 


60.9 


0.89 (0.73 to 1.11) 


15.1; 2.20 


86.2 


Epsilon-aminocaproic 
acid 


0.79 (0.50 to 1.30) 


69.2; 1.49 


83.1 


0.78 (0.60 to 1.03) 


81.5; 1.25 


96.6 


Stroke: 


Aprotinin 


Reference group 


15.7; 2.64 


Reference group 


Reference group 


8.0; 2.76 


Reference group 


No treatment 


1 .05 (0.40 to 2.23) 


11.5; 2.83 


44.8 


1.14 (0.68 to 1.89) 


5.7; 3.32 


30.3 


Tranexamic acid 


1.06 (0.33 to 2.63) 


13.2; 2.82 


45.1 


0.81 (0.48 to 1.40) 


52.7; 1 .73 


79.5 


Epsilon-aminocaproic 
acid 


0.72 (0.15 to 2.02) 


59.6; 1.72 


73.7 


0.89 (0.48 to 1.59) 


33.6; 2.18 


66.5 


Renal failure or 
dysfunction: 


Aprotinin 


Reference group 


2.7; 3.38 


Reference group 


Reference group 


0;3.98 


Reference group 


No treatment 


0.83 (0.50 to 1.37) 


24.0; 2.48 


77.8 


0.66 (0.45 to 0.88) 


33.5; 2.04 


99.0 


Tranexamic acid 


0.82 (0.31 to 1.68) 


24.2; 2.43 


73.2 


0.66 (0.48 to 0.91) 


30.3; 2.04 


99.0 


Epsilon-aminocaproic 
acid 


0.74 (0.23 to 1 .43) 


42.9; 2.03 


82.6 


0.65 (0.45 to 0.88) 


36.0; 1.94 


99.6 



RCT=randomised controlled trial. 

"Value (possible range 0-100%) was estimated by counting the number of times out of the sampling iterations that treatment was associated with the odds ratio 
most suggestive of largest reduced risk of the outcome. 

tAverage rank (possible score range 1-4) was estimated by averaging the rank assigned across the sampling iterations from the simulation done to estimate 
pairwise odds ratios. A higher average rank suggests a lesser risk of the outcome. 

^Probability that aprotinin is associated with an increased risk of the clinical outcome relative to its comparator — that is, a higher probability is unfavourable for 
aprotinin. 
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Figures 



Records identified through database searching (n=155) 
\ 

Records screened after duplicates removed (n=96) 

— *■ Records excluded due to irrelevancy (n=81) 

Full text articles assessed for eligibility (n=15) 

Full text articles excluded (n=4): 
Included off-pump procedures (n=l) 
Lumped lysine analogue therapies into one group (n-1) 
Could not be acquired (n=2) 

— — Studies included from 2011 Cochrane review (n=106) 

Studies included (n=106 randomised controlled trials; 
11 observational studies) 

Fig 1 Flow diagram of study identification process 



J 



Death (49) 
Ml (47) 
Stroke (21) 
Renal (26) 



No treatment 



Aprotinin 



Death (19) 
Ml (11) 
Stroke (9) 
Renal (7) 



Tranexamic acid 



Death (2 2) 
Ml (16) 
Stroke (16) 
Renal (7) 



Death (5) 
Ml (4) 
Stroke (4) 
Renal (2) 



Death (10) 
Ml (7) 
Stroke (6) 
Renal (6) 



Death (7) Stroke (8) 
Ml (7) Renal (2) 



Epsilon-aminocaproic acid 



Fig 2 Network of amounts of available evidence for clinical outcomes of interest in both randomised and observational 
studies. MI=myocardial infarction; renal=renal failure or dysfunction 



Mortality 

Aprotinin v no treatment 
Aprotinin v tranexamic acid 
Aprotinin v epsilon-aminocaproic acid 

No treatment vtranexamic acid 

No treatment v epsilon-aminocaproic acid 

Tranexamic acid vepsilon-aminocaproic acid 



Odds ratio 
(95% credible 
interval) 




Odds ratio 
(95% credible 
interval) 

0.92 (0.71 to 1.15) 
0.71 (0.50 to 0.98) 
0.60 (0.43 to 0.87) 

0.78 (0.53 to 1.12) 
0.66 (0.45 to 1.01) 

0.85 (0.56 to 1.37) 



Favours second 
treatment 



Fig 3 Summary of findings from mixed treatment comparisons meta-analysis of data on mortality (estimated between study 
standard deviation 0.32) 
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Myocardial infarction 

Aprotinin v no treatment 
Aprotinin vtranexamic acid 
Aprotinin v epsilon-aminocaproic acid 

No treatment v tranexamic acid 

No treatment i/epsilon-aminocaproic acid 



Tranexamic acid vepsilon-aminocaproic acid 



Odds ratio 
(95% credible 
interval) 




Odds ratio 
(95% credible 
interval) 

0.98 (0.81 to 1.20) 
0.89 (0.73 to 1.11) 
0.78 (0.60 to 1.03) 

0.92 (0.71 to 1.15) 
0.80 (0.60 to 1.04) 

0.87 (0.66 to 1.16) 



Favours second 
treatment 



Fig 4 Summary of findings from mixed treatment comparisons meta-analysis of data on myocardial infarction (estimated 
between study standard deviation 0.17) 



Stroke 

Aprotinin v no treatment 
Aprotinin vtranexamic acid 
Aprotinin v epsilon-aminocaproic acid 

No treatment vtranexamic acid 

No treatment v epsilon-aminocaproic acid 

Tranexamic acid vepsilon-aminocaproic acid 



Odds ratio 
(95% credible 
interval) 




Odds ratio 
(95% credible 
interval) 

1,14 (0.68 to 1.89) 
0.81 (0.48 to 1.40) 
0.89 (0.49 to 1.59) 

0.71 (0.39 to 1.35) 
0.78 (0.39 to 1.55) 

1.09 (0.53 to 2.15) 



Favours second 
treatment 



Fig 5 Summary of findings from mixed treatment comparisons meta-analysis of data on stroke (estimated between study 
standard deviation 0.54) 



Renal failure or dysfunction 

Aprotinin v no treatment 
Aprotinin vtranexamic acid 
Aprotinin v epsilon-aminocaproic acid 

No treatment v tranexamic acid 

No treatment i/epsilon-aminocaproic acid 

Tranexamic acid v epsilon-aminocaproic acid 



Odds ratio 
(95% credible 
interval) 




Odds ratio 
(95% credible 
interval) 

0.66 (0.48 to 0.93) 
0.66 (0.48 to 0.91) 
0.65 (0.45 to 0.88) 

1.00 (0.64 to 1.52) 
0.98 (0.61 to 1.48) 

0.98 (0.64 to 1.45) 



0.2 0.5 0.8 1 

Favours second 
treatment 



Favours first 
treatment 



Fig 6 Summary of findings from mixed treatment comparisons meta-analysis of data on renal failure or dysfunction (estimated 
between study standard deviation 0.30) 
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